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Abstract 

How people perceive the nature of a hazardous substance may determine how they respond when 
potentially exposed to it. We tested a new Perceptions AbouT Hazardous Substances (PATHS) 
questionnaire. In Study I (N = 21), we assessed the face validity of items concerning perceptions about 
eight properties of a hazardous substance. In Study 2 (N = 2030), we tested the factor structure, 
reliability and validity of the PATHS questionnaire across four qualitatively different substances. In Study 3 
(N = 760), we tested the impact of information provision on Perceptions AbouT Hazardous Substances 
scores. Our results showed that our eight measures demonstrated good reliability and validity when used 
for non-contagious hazards. 
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Introduction 

Accidents or disasters involving the sudden expo- 
sure of large numbers of people to a hazardous 
substance are common. How members of the pub- 
lic react during such incidents plays a large role in 
determining their overall impact (Wray et al, 
2008). For example, low uptake of emergency 
prophylaxis during an anthrax incident (e.g. 
SteelFisher et al., 2011), unnecessary mass evacu- 
ation away from a nuclear reactor (e.g. Ziegler et 
al, 1981), surges of unaffected people seeking 
treatment at hospital during an infectious disease 
outbreak (e.g. Chang et al, 2004) and the long- 
term avoidance and stigmatisation of community 
members following a radiological incident (e.g. 
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Petterson, 1988) have all previously been observed 
and are likely to hamper a population's short- and 
long-term recovery from a disaster. However, 
these reactions can vary widely (Rogers et al, 
2007). Existing theories of risk perception provide 
some explanation for this, with two factors often 
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singled out as important: a person's perceptions 
about how likely they are to be affected and their 
perceptions about how severe any effects will be 
(Brewer et al, 2007; Leppin and Aro, 2009; 
Markon et al., 2011). While undoubtedly impor- 
tant, a narrow focus on perceptions of severity 
and likelihood is of limited usefulness to those 
who need to communicate with the public during 
a major incident. From their perspective, under- 
standing why people believe that they are likely 
to encounter a hazard and why they believe that 
its effects are severe or are not severe is more 
important, as it may provide a better indication 
of what issues to address when talking to an 
affected community. 

Other models of risk perception propose a 
broader range of determinants for how people 
respond to risks. For example, 15 characteris- 
tics were proposed by Slovic (1987) as differen- 
tiating risks that people are likely to accept 
from those that cause controversy. Many of 
these characteristics were properties of the haz- 
ard itself; is it observable, for example, or are 
its effects delayed? Although providing a more 
fine-grained approach to understanding risk 
perception, these characteristics were not spe- 
cifically designed with a sudden major public 
health incident in mind. 

Designing a questionnaire to assess the per- 
ceptions that people hold about a major incident 
would be useful in advancing our understand- 
ing of behavioural and emotional responses to 
these events. Although many categories of per- 
ceptions might be important, one set of percep- 
tions that is particularly relevant is how an 
individual views the innate properties of a haz- 
ardous substance itself. In this article, we report 
three studies in which we tested a new question- 
naire, which assesses Perceptions AbouT 
Hazardous Substances ('PATHS'). 

Study I : piloting 

In order to determine the types of perception that 
should be included in the PATHS, we reviewed 
previous qualitative studies that have explored 
how people perceive the risks associated with a 



hazardous substance (Cava et al., 2005; Etchegary 
et al, 2008; Glik et al., 2004, 2008; Janssen et al, 
2006; Palinkas et al, 1993; Rubin et al, 2007, 
2010; Stein et al, 2004; Wray et al, 2008). Nine 
categories occurred repeatedly in this literature as 
reflecting the main relevant beliefs: perceptions 
about the severity of the health effects that a sub- 
stance can trigger, the difficulty that people can 
experience in differentiating the symptoms caused 
by a hazard from those of other common ill- 
nesses, the possibility of a latency period 
between exposure to a substance and the appear- 
ance of the first symptoms, the potential for 
exposure to cause hidden harm that may not 
become apparent for many years, the ease or dif- 
ficulty of detecting exposure, the perceived 
mechanisms through which a substance can exert 
its effects, the perception that a hazardous sub- 
stance exerts severe effects on specific at-risk 
groups, the perceived environmental persistence 
of a substance and an overarching sense of 
uncertainty or mystery that people feel about 
hazardous substances. 

Methods 

We generated 56 items to cover our nine domains, 
guided by our literature review and by adapting 
items from the Revised Illness Perceptions 
Questionnaire (IPQ-R; Moss-Morris et al, 2002), 
which measures some related concepts. Items 
were formulated as statements with responses 
ranging from strongly disagree (scored as 1) to 
strongly agree (5). Most items were intended to 
be combined into scales. However, perceptions 
relating to the mechanisms of action of a sub- 
stance were measured using single items. 

We piloted the items with a convenience 
sample of 2 1 participants recruited by sending 
an invitation e-mail to our institution's database 
of research volunteers (age range: 18 to 72 
years; 14 female; 14 White British). Each was 
asked to consider one of four substances during 
a 30-minute telephone interview: polonium 210, 
anthrax, swine flu or carbon monoxide. These 
reflected qualitatively different substances that 
we expected participants to have some 
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awareness of because they have been widely 
discussed in the British media following the 
Alexander Litvinenko affair, the US anthrax 
attacks, the 2009/2010 flu pandemic and public 
health campaigns about carbon monoxide. We 
asked participants to complete the PATHS for 
their selected hazard and to explain each answer 
or rephrase each question in their own words. 
Items that appeared difficult to understand were 
revised after every fourth interview. Ethical 
approval for this and all other studies was given 
by the King's College London Research Ethics 
Committee. 

Results and discussion 

We made several minor clarifications to item 
wording during the piloting. Piloting also revealed 
two more problematic issues. First, creating items 
to assess environmental persistence proved chal- 
lenging, as persistence is a property of both the 
substance and the prevailing environmental con- 
ditions. We, therefore, made these questions con- 
ditional on a substance remaining within a stable 
environment. Second, it became apparent that 
questions about the ease with which someone 
could detect a substance needed to be qualita- 
tively different when asked about a contagious 
disease, where concern focuses on detecting peo- 
ple who pose a risk. Our revised items are given 
in supplementary file 1 . 

Study 2: reliability and 
validity 

In Study 2, four groups of participants com- 
pleted the PATHS with respect to polonium 
210, carbon monoxide, anthrax or swine flu. 
Responses were given at two time-points and 
were used to test the factor structure, internal 
consistency and test-retest reliability of the 
scales. For the questionnaire's validity, we 
hypothesised that scores would differ depend- 
ing on what substance was being considered. 
We also hypothesised that scores would not 
simply reflect a stable personality trait and 
therefore tested their correlation with a measure 



of trait affect. To assess whether different haz- 
ardous substances trigger different levels of 
concern because of differences in the way peo- 
ple perceive them, we tested whether percep- 
tion scores mediated any difference between the 
four substances in terms of how worried a par- 
ticipant felt someone should be if exposed to 
them. We predicted that any differences in 
worry between the four substances would be 
reduced once differences in the PATHS scores 
were controlled for. 

Methods 

Participants. Participants were members of an 
online panel maintained by the market research 
company Ipsos MORI. All were aged 16 years 
or more. 

Questions. Participants first completed our 
items in relation to polonium 210, carbon mon- 
oxide, anthrax or swine flu. Items were pre- 
sented in a random order. Participants were then 
asked how worried someone should be if they 
were exposed to the substance in question for 
the first time and felt ill 3 days later and if they 
were exposed to the substance for the first time 
and felt fine for the next 3 days. Responses 
could range from 0 (not at all worried) to 7 
(extremely worried). Finally, participants com- 
pleted the 10-item short form of the trait posi- 
tive and negative affect schedule (PANAS 
(Thompson, 2007)). 

Procedure. Potential participants were sent an 
email invitation for a survey about 'health 
risks'. Those who gave consent were allocated 
at random to one of the four versions of the sur- 
vey, reminded of a previous incident involving 
their allocated substance and asked whether, 
before today, they had ever seen or heard any- 
thing about it. Those who had not previously 
heard of it were excluded. The remainder com- 
pleted the first survey (time 1) immediately. 
After 1 week, participants were asked to com- 
plete a second identical survey (time 2). Recruit- 
ment for each version of the questionnaire was 
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halted after 500 participants had completed it at 
time 1, a sample size which would allow us an 
adequate participant to item ratio for an explor- 
atory factor analysis. 

Analysis. We used exploratory factor analysis 
to assess the clustering of items that were 
intended for use as scales. This was performed 
separately for each version of the questionnaire, 
using time 1 data. We used principal axis factor- 
ing, examined scree plots to determine how 
many factors to extract and performed oblique 
rotation using direct oblimin. Pattern matrices 
for the four versions of the questionnaire were 
compared in order to identify items that consist- 
ently loaded onto the extracted factors across 
the different versions. We interpreted items that 
tended to load 0.45 or higher across versions as 
representing a factor. Factor scores were calcu- 
lated by taking the mean of those items that 
loaded onto them, with items reverse scored 
where required. Internal reliability was tested 
by checking for adequate Cronbach's alphas 
(between 0.7 and 0.90), item-total correlations 
and inter-item correlations (between 0.2 and 0.9 
for both) (Streiner and Norman, 2008). Test- 
retest reliability was calculated using intra-class 
coefficients for scales and linearly weighted 
kappa coefficients for individual items. 

Validity was assessed by testing whether the 
results for the scales and individual items dif- 
fered between the questionnaire versions (using 
analyses of variance and x 2 tests) and whether 
the scales or individual items correlated with 
trait affect. We also tested whether the scales 
and individual items mediated any difference 
between the four questionnaire versions with 
respect to worry by using binary logistic regres- 
sions to assess the impact of including percep- 
tions as potential mediators. 

Results and discussion 

Participants. Time 1 questionnaires were answered 
by 2030 people (between 506 and 511 people com- 
pleting each version). Time 2 questionnaires were 
answered by 1327 people (between 311 and 350 



people per version). The mean age of the sample 
was 41.27 years (standard deviation 14.48) at time 
1 . Men accounted for 5 1 .4 per cent of the sample. 
Analyses of variance and x 2 tests identified no 
differences between questionnaire versions in 
terms of age or sex at either time 1 or time 2 (all 
tests,/; > .73). 

Factor structure, reliability and validity. Prelimi- 
nary factor analyses identified inconsistent 
loadings for those items that were intended to 
measure environmental persistence. These were 
removed from all the further analyses. Re-run- 
ning the factor analyses suggested the presence 
of six (polonium 210, carbon monoxide, 
anthrax) or five (swine flu) factors, accounting 
for between 47.4 per cent and 50.5 per cent of 
the variance. The pattern matrix for each ver- 
sion is given in supplementary files 2 to 5. 

Loadings for the six factors in the polonium 
210, carbon monoxide and anthrax versions were 
similar. They related to perceptions that the haz- 
ard would cause serious health effects (loaded on 
by six items), the potential for hidden harm (five 
items), the difficulty in differentiating health 
effects from those caused by other illnesses 
(three items), the ease of detecting exposure 
(three items), the mysterious nature of the hazard 
(four items) and the existence of at-risk groups 
(six items). Table 1 shows the Cronbach's alphas, 
item-total correlations and inter-item correla- 
tions for these scales, all of which were accepta- 
ble. Because Cronbach's alpha exceeded 0.90 for 
the 'existence of at-risk groups' scale in all three 
versions of the questionnaire, we reduced it to 
four items while retaining acceptable levels of 
internal consistency. Table 2 shows the results 
for the test-retest analyses. Test-retest reliability 
was fair to good for the scales and fair to moder- 
ate for individual items. Appendix 1 shows the 
items retained in the final version of the 
questionnaire. 

The loadings for the five swine flu factors 
suggested that they reflected perceptions about 
the mysteriousness of swine flu (4 items), the 
general harm that could arise from the illness (12 
items), the presence of at-risk groups (6 items), 
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Table 2. Test-retest reliability for scales and items for the polonium 210, carbon monoxide or anthrax 
versions of the questionnaire (Study 2). 

Scale (number of items) Intra-class correlation coefficient (for scales: 

ICC2 (A, I )) or weighted kappa (for single item) 
with 95% confidence interval in parentheses 



Mystery (4) 


0.77 (0.74-0.79) 


Serious health effects (6) 


0.71 (0.67-0.74) 


Hidden health effects (5) 


0.68 (0.64-0.71) 


Easy to spot exposure (3) 


0.64 (0.60-0.67) 


Diffif"! ilr r<"i Hicprimin^l"p ^vmntnmc ( 3 1 

L/l 1 1 ILU 1 L LU llllllldLG JYI 1 IULUI 1 Ij 1 J j 


0 53 ft) 48-0 581 


The existence of at-risk groups (4) 


u.j 1 ^U.iO-U.jjj 


1 think that X can affect your health if 




You breathe in air that contains X (1) 


0.42 (0.37-0.47) 


You eat food that has been contaminated 


0.58 (0.54-0.62) 


by X and has not been cooked (1) 




You eat food that has been contaminated 


0.52 (0.49-0.56) 


by X and has been cooked ( 1 ) 




You touch X but do not breathe it in or 


0.49 (0.45-0.54) 


put it near your mouth ( 1 ) 




You are coughed or sneezed on by a 


0.54 (0.51-0.58) 


person who is currently ill because of X (1) 




You come within 1 m (3 ft) of polonium 


0.43 (0.35-0.50) 


2 1 0, but do not breathe it in or touch h? ( 1 ) 




How long does it usually take for the first 


0.47 (0.42-0.52) 



signs of ill health to start to appear? (I) 



•Item only asked in polonium 210 version of the questionnaire. 



the mildness of the symptoms (2 items) and a 
fifth factor that was difficult to interpret. 
Cronbach's alphas, item-total correlations and 
inter-item correlations for these scales were sat- 
isfactory (data not shown). As for the other ques- 
tionnaire versions, we were able to reduce the 
at-risk groups scale to four items without 
adversely affecting its internal reliability. Test- 
retest reliability was fair to good for the scales 
and fair to moderate for the individual items. 

Mean scores or frequencies for each hazard are 
given in Table 3 . Analyses of variance (all F statis- 
tics > 1 6.76, p < .00 1 ; see Table 3 for results of the 
post hoc Tukey's tests) and a/ 2 test (x 2 = 543.62, 
degree of freedom (df) = 18, p < .001) confirmed 
that significant differences existed between the 
various questionnaire versions for every scale and 
individual item, excluding those swine flu scales 
that could not be compared because of their differ- 
ent compositions. The differences were logical. 



The two more unusual hazards (polonium 210 and 
anthrax) were seen as being more mysterious and 
as more likely to cause serious or hidden health 
effects than carbon monoxide and swine flu. 
Polonium 210 was rated as more difficult to detect 
than carbon monoxide or anthrax. Carbon monox- 
ide, which generally causes flu-like symptoms, 
was rated as having symptoms that are more dif- 
ficult to distinguish from other common causes 
than polonium 210 or anthrax. Swine flu was 
rated as being most likely to have clearly identifi- 
able 'at-risk' groups, in accordance with recent 
advertising campaigns in the United Kingdom, 
urging at-risk groups to be vaccinated. The differ- 
ent perceptions about mechanisms were also logi- 
cal: carbon monoxide was rated as most likely to 
affect you by being breathed in; polonium 210, 
anthrax and swine flu, but not carbon monoxide, 
were seen as risks if present on food, though swine 
flu was seen as less risky if the food was cooked; 
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Table 3. Mean scores or frequencies (standard deviations or %) for Study 2. 



Scale or item a 


Polonium 


1 1 ft 
L 1 U 


Carbon monoxide 


Anthrax 




Swine flu^ 


Mysterious 


3.50 


v u 


82) cd 


2.63 


(0 


74\e,f 
' V 


3.40 


(0 


72) cd 


2.7 (0.72)=. 


Serious health effects 


J.OZ 


in 


59) c ' f 


1 44 


to 


7 1 W 


J.70 


in 


57) ce 


Not used 


Hidden health effects 


"3 3Q 
J.J7 


(0 


55) c ' f 


") Q4 




£7\e,f 
0/ ) ' 


j. Id 


(° 


60)« 


Not used 


Easy to spot 


1 ./j 




67) cf 


1 no. 


in 


77\e 


1 1 9 
z. 1 7 


\ u 


66) e 


Not used 


Difficult to discriminate symptoms 


3.35 


(0 


65)^ f 


3.59 


(0 


69) ef 


3.23 


(0 


59)« 


Not used 


/ \ l_ 1 1 o l\ XLl UUUj CAlJL 


3.78 


(0 


821 cd 


4.01 


(0 


80) de ' f 


3.83 


(0 


79V,d 


417/O 69^ 


1 LI 1 II IK LI 1d.L /\ l_cll 1 clIICt-L YUUI lltrcllLI 


if 




















Yoi i hrpathp in air that rontain^ ^ 

1 \JU LSI Cull IC II 1 all LI luL LUI ILClll lo /\ 


3.76 


(0 


791c,d,f 


4.39 


(0 


77)d,e,f 


4.09 


(0 


771 ce 


4 03 (0 73^ 


You eat food that has been 


3.93 


(0 


0 1 r' 


2.42 


(1 


04)d.e,f 


3.83 


(0 


Q"i\c d 
CO / ' 


J.^rZ ^ 1 U. 1 ) 


contaminated by X and has not 






















been cooked 






















You eat food that has been 


3.86 


(0 




2.29 


(0 


98)d.e.f 


3.52 


(0 


86) cde 


2.64 (0.96) 


contaminated by X and has 






















been cooked 






















You touch X but do not 


3.33 


(0 


86) cd 


2.05 


(0 


93)d,e,f 


3.37 


(0 


92) cd 


2.95 (1.01) 


breathe it in or put it near your 






















mouth 






















You are coughed or sneezed 


2.73 


(0 


86)^' 


1.87 


(0 


8|)d.e,f 


3.25 


(0 


92)cd,a 


4.18 (0.70) 



on by a person who is 
currently ill because of X 

You come within I m (3 ft) 3.06 (0.84) 
of polonium 2 1 0, but do not 
breathe it in or touch its 
How long does it usually take for the first signs of i 

Less than 24 hours 1 45 (28.7%) 

24 hours to 2 days 210(41.5%) 

3 to 6 days 72(14.2%) 

I to 2 weeks 37 (7.3%) 

3 weeks to I month 1 2 (2.4%) 

I to 2 months 10(2.0%) 

More than 2 months 20 (4.0%) 



Not asked Not asked 



health to start to appear? h 



335 (66.1%) 
91 (17.9%) 
29 (5.7%) 
18 (3.6%) 
12 (2.4%) 
4 (0.8%) 
18 (3.6%) 



192 (37.9%) 
214 (42.3%) 
58 (I 1.5%) 
22 (4.3%) 
I I (2.2%) 
2 (0.4%) 
7 (1.4%) 



Not asked 



27 (5.3%) 
290 (56.8%) 
158 (30.9%) 
32 (6.3%) 
2 (0.4%) 
0 (0%) 
2 (0.4%) 



All significant differences were at the p < .01 level. 

a AII scores range from I to 5, except for 'how long does it usually take for the first signs of ill health to start to appear'. 
High scores indicate greater agreement with the scale or item. 

b Only scores for scales that were directly comparable to the other questionnaire versions are given. 

'Significantly different to carbon monoxide. 

d Significantly different to swine flu. 

e Significantly different to polonium 210. 

'Significantly different to anthrax. 

Only asked for the polonium 210 version. 

frequencies (%) given. 



polonium 210 and anthrax were seen as risky if 
touched and swine flu was seen as particularly 
likely to be passed on by coughs or sneezes. 
Finally, the latency between exposure and the first 
symptoms appearing was logical, with carbon 



monoxide being seen by most participants as having 
an immediate effect (<24 hours: 66.1%), polo- 
nium 210 and anthrax as taking between 24 hours 
and 2 days to have an effect (endorsed by 41.5% 
and 42.3% of respondents, respectively) and 
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swine flu as taking either from 24 hours to 2 days 
(56.8%) or between 3 and 6 days (30.9%) to take 
effect. 

Perception scales and items for the polonium 
210, carbon monoxide and anthrax versions of 
the questionnaire showed only weak correla- 
tions with the PANAS scores (all Spearman's 
rho < 0.20). 

Association with worry. The two worry scores 
were strongly correlated (r = .70, p < .001). We 
combined them by taking the mean. Because 
the mean showed negative skew, we recoded it 
into scores of 0^ (low worry) and 4.5-7 (high 
worry). There was a significant difference in the 
level of worry that participants felt someone 
should feel after exposure to the hazards (% 2 - 
490.23, df = 3, p < .001). More people felt that 
exposure to polonium 210 or anthrax should 
lead to a high level of worry (80.8% and 82.6%, 
respectively) than exposure to carbon monox- 
ide or swine flu (36.1% and 30.5%). Post hoc 
tests showed no significant difference between 
polonium 210 and anthrax (y} = 0.54, df = 1, p 
= .52) or between carbon monoxide and swine 
flu (x 2 = 3.55, df= l,p = .06). 

To assess whether PATHS scores mediated 
the differences, we compared polonium 210 
with carbon monoxide and anthrax with carbon 
monoxide. A binary logistic regression con- 
firmed that polonium 210 was associated with 
more worry than carbon monoxide (odds ratio 
(OR) = 7.47, 95% confidence interval (CI) = 
5.61-9.94). With all PATHS measures included 
in the regression, this association was reduced, 
but remained significant (adjusted OR (aOR) = 
2.56, CI = 1.61-4.08). Only three PATHS meas- 
ures showed a significant association with 
worry in the regression: the perception that the 
health effects of exposure were severe (aOR = 
2.47, CI = 1.89-3.24), the perception that expo- 
sure might cause hidden health effects (aOR = 
1.68, CI = 1.26-2.26) and the perception that 
the hazard could affect health if touched (aOR = 
1.26, CI = 1.03-1.54). We observed a similar 
pattern of results when comparing anthrax and 
carbon monoxide. An initial regression confirmed 



the difference in terms of worry (OR = 8.41, 
CI = 6.28-11.27), which was reduced when 
PATHS measures were entered (aOR = 2.48, 
CI = 1.59-3.87). The only perception variables 
that showed a significant association with worry 
were the perceptions that the health effects of 
exposure were severe (aOR= 2.24, CI = 1.69-2.97), 
that exposure might cause hidden health effects 
(aOR = 1.53, CI = 1.15-2.03) and that some- 
one's health could be affected by being coughed 
or sneezed on by a person who was ill (aOR = 
1.44, CI = 1.15-1.78). 

Study 3: effect of 
information provision 

In Study 3, we tested whether PATHS scores 
were amendable to change by providing three 
groups of participants with three different types 
of information about carbon monoxide before 
asking them to complete the PATHS. We 
hypothesised that, in comparison to a control 
condition, information that emphasised the 
severity of the health effects caused by carbon 
monoxide would specifically elevate percep- 
tions relating to severity, while information that 
emphasised the possibility of chronic health 
issues would raise perceptions that carbon mon- 
oxide causes hidden health effects and reduce 
perceptions that the first symptoms become 
apparent soon after exposure. As an additional 
test of the role of perceptions in determining 
levels of concern about a hazardous substance, 
we also assessed whether our information had 
any impact on levels of worry. 

Methods 

Participants. We recruited a new sample of 
participants from the Ipsos MORI panel. We 
aimed to halt recruitment after 750 people had 
completed the survey. 

Questions. We asked participants to complete 
the carbon monoxide version of the PATHS, 
followed by the two worry items used in Study 
2, rated on a 0-6 scale. Participants were also 
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asked to evaluate the whole survey using five 
items, which asked for their opinion on overall 
satisfaction, survey topic, language/grammar, 
the time spent to complete the survey and ques- 
tion formulation and the instructions given. 
Response options used the colloquial phrases 
'yuck', 'bad', 'meh', 'good' or 'brilliant'. 

Procedure. Participants were recruited using 
the same procedure as Study 2 and were ran- 
domised to receive one of the three informa- 
tion passages regarding carbon monoxide (see 
supplementary file 6). The first acted as our 
control condition and described how carbon 
monoxide is produced. The second focused on 
the severity of the health effects caused by 
carbon monoxide (severe information condi- 
tion). The third focused on the possibility that 
poisoning could give rise to health effects 
months or years after exposure (chronic infor- 
mation condition). 

Analysis. We used exploratory factor analyses 
to check the clustering of items. We used one- 
way analyses of variance and x 2 tests to test the 
effects of information provision on PATHS 
results and levels of worry. 

Results and discussion 

Each condition was completed by 253 or 254 
participants. There were no differences 
between the groups in terms of the proportion 
of women (48.8%; x 2 = 0.07, p = .97), mean 
age (41.2 (standard deviation = 14.7); F(2, 
757) = 0.04, p = .99) or highest educational 
qualification (10% postgraduate degree, 
36.5% bachelor's degree, 23.7% A-level, 8.3% 
vocational qualification, 21.5% General 
Certificate of Secondary Education (GCSE; a 
UK examination taken by 16-year-old chil- 
dren); x 2 = 9.8,/? = .28). 

The data for each condition showed an iden- 
tical six-factor structure, replicating that in 
Study 2 (data not shown). 

There were significant differences between 
the three groups in terms of their perceptions 



about the severity of carbon monoxide poison- 
ing (F(2, 757) = 25.67, p< .001), the likelihood 
of it causing hidden health effects (F(2, 757) = 
143.65,/) < .001), the difficulty of discriminat- 
ing the symptoms of carbon monoxide poison- 
ing from other conditions (^(2, 757) = 19.83,/) 
< .001) and the latency of the first symptoms 
following exposure (x 2 = 25.05, df = 12, p = 
.02). Post hoc Tukey's tests (Table 4) revealed 
that the severe information condition resulted in 
increased perceptions of the severity of carbon 
monoxide poisoning compared to both the 
chronic and control conditions, and that the 
chronic information condition (which also men- 
tioned some health effects of exposure) 
increased perceptions of severity in comparison 
to the control information. The chronic infor- 
mation condition resulted in higher perceptions 
that carbon monoxide might cause hidden 
health effects than either of the other conditions 
and reduced the number of people who felt that 
the first effects of carbon monoxide poisoning 
would appear within 24 hours. Finally, while 
emphasising the severe nature of the effects of 
carbon monoxide made people feel that its 
effects are easy to distinguish from those result- 
ing from other causes, our chronic information 
condition had the opposite effect. 

Our two worry items showed a smaller 
correlation than in Study 2 (r= .56, p < .001) 
and were not combined. As for Study 2, we 
dichotomised them into scores of 0-4 or 5 
and 6. There was no difference between the 
groups in terms of the level of worry they felt 
someone should feel 3 days after exposure to 
carbon monoxide if feeling ill (x 2 - 1.80, df = 
2,p = .41) or feeling fine (j 2 = 1.24, df =2, 
p=.54). 

Between 612 and 615 people (81%) com- 
pleted each survey evaluation question. For 
every question, most participants (91.5%-95.4%) 
rated the survey as good or brilliant. 

Discussion 

The PATHS questionnaire provides reliable, 
valid measures of the perceptions people hold 
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Table 4. Mean scores or frequencies (standard deviation or %) for the carbon monoxide questionnaire 
following provision of information emphasising the severity of its effects, the chronic nature of its effects or 
a control condition (Study 3). 

Scale or item* 'Severe' information 'Chronic' information 'Control' information 

Mysterious 2.54 (0.74) 2.64 (0.73) 2.54 (0.74) 

Serious health effects 3.64 (0.73)" 3.21(0.62)" 3.43 (0.71 ) c d 

Hidden health effects 3.06 (0.73) c 3.94 (0.50)" 3.06 (0.75) c 

Easy to spot 2.02 (0.71) 2.02 (0.71) 2.04 (0.78) 

Difficult to discriminate 3.41(0.77)" 3.80 (0.54)" 3.57 (0.75) cd 

symptoms 

'At-risk' groups exist 4.05 (0.9 1 ) 4. 1 0 (0.73) 4. 1 6 (0.7 1 ) 

I think that carbon monoxide can affect your health if 

You breathe in air that 4.44 (0.75) 4.42 (0.77) 4.38 (0.75) 

contains it 

You eat food that has been 2.5 1 ( 1 . 1 6) 2.5 1 ( 1 .06) 2.36 (1.13) 

contaminated by it and has not 
been cooked 

You eat food that has been 2.27 (1.05) 2.37 (0.95) 2.24 (1.03) 

contaminated by it and has 
been cooked 

You touch it but do not 2.06 ( 1 .02) 2.04 (0.85) 1 .90 (0.89) 

breathe it in or put it near 
your mouth 

You are coughed or sneezed 1.80 (0.96) 1.79 (0.81) 1.67 (0.80) 

on by a person who is 
currently ill because of it 
How long does it usually take for the first signs of ill health to start to appear? e 

Less than 24 hours 202 (79.5%) 160 (63.2%) 187 (73.9%) 

24 hours to 2 days 37(14.6%) 58 (22.9%) 46(18.2%) 

3 to 6 days 5(2.0%) 10(4.0%) 9(3.6%) 

I to 2 weeks 4 ( 1 .6%) 5 (2.0%) 4 ( 1 .6%) 

3 weeks to I month 2 (0.8%) 6 (2.4%) 3 ( 1 .2%) 

I to 2 months I (0.4%) 2 (0.8%) 2 (0.8%) 

More than 2 months 3 ( 1 .2%) 1 2 (4.7%) 2 (0.8%) 

All significant differences were at the p < .05 level. 

a AII scores range from I to 5, except for 'how long does it usually take for the first signs of ill health to start to appear'. 

High scores indicate greater agreement with the scale or items. 

Significantly different to control condition. 

'Significantly different to chronic condition. 

Significantly different to severe condition. 

'Frequencies (%) given. 



about the properties of non-contagious haz- 
ardous substances. Study 1 demonstrated that 
the questions are readily understood and can 
be applied to any hazardous substance with 
only minor rewording. Study 2 demonstrated 
that our attempt to produce a measure of 
the environmental persistence of a hazardous 



substance was unsuccessful. This was proba- 
bly because of the range of factors (including 
prevailing environmental conditions) that 
determine persistence. However, our other 
items clustered as expected for the three non- 
contagious hazards, producing scales that 
were internally consistent and had good test-retest 
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reliability. Test-retest reliability for our sin- 
gle-item measures was lower, though still 
comparable to that for similar items designed 
by others (Barr et al., 2008). Face validity for 
the measures relating to non-contagious haz- 
ards was established in Study 1, while their 
lack of association with measures of trait 
affect (Study 2), their ability to discriminate 
between different types of hazard (Study 2) 
and their amenability to change when people 
were presented with different types of infor- 
mation (Study 3) all add weight to their validity. 

Although the PATHS questionnaire per- 
formed well for non-contagious hazards, this 
was not true when we used it to assess percep- 
tions of swine flu. This may reflect a deeper 
distinction in the way people perceive conta- 
gious and non-contagious hazards. While non- 
contagious agents are often seen as separable 
from a person and as present in the environ- 
ment, people may find it difficult to appreciate 
the difference between a virus or bacteria and 
the contagious disease that it causes. Although 
we tried to make this explicit by asking partici- 
pants to consider 'the germs that cause swine 
flu', it is possible that people were still think- 
ing about the illness when responding. 
Additional research to explore and measure 
the perceptions that people hold about conta- 
gious illnesses would be justified, for exam- 
ple, how contagious the illness is and how it 
can be contracted. 

Despite this, our questionnaire fills a gap 
that exists in our ability to understand percep- 
tions during a major public health incident 
involving a non-contagious hazardous sub- 
stance. At present, research in this field focuses 
on assessing the perceived severity of being 
exposed to a given substance and the perceived 
likelihood of being exposed to it. Assessing per- 
ceptions about the nature of the substance caus- 
ing the risk has been neglected by researchers. 
This is surprising. Although a person's 'mental 
model' of an external threat can determine 
whether or not they take protective actions in 
relation to it (Morgan et al., 2001), a question- 
naire to assess the more common themes within 



these perceptions has, until now, been unavail- 
able. The availability of the PATHS question- 
naire should help communicators to understand 
whether members of the public hold percep- 
tions about a given substance that are substan- 
tially out of step with scientific knowledge, and 
whether those perceptions are, in turn, associ- 
ated with levels of worry or changes in behav- 
iour. By targeting perceptions that are associated 
with the outcomes of interest, using messages 
that are designed following best practices in 
risk communication (e.g. Wray et al., 2008), it 
may be possible to promote more adaptive 
responses to an incident involving hazardous 
materials. 

Evidence that PATHS do indeed partly deter- 
mine responses to them can be found in our own 
Study 2, with the association between a hazard 
and ratings about how worried someone should 
feel once exposed to it being substantially 
reduced once perceptions about the hazard were 
controlled for. On the other hand, experimen- 
tally manipulating perceptions in Study 3 did 
not affect levels of worry. It is possible, then, 
that there is no causal association between the 
perceptions we assessed and worry, or that a per- 
son's emotional response determines their initial 
perceptions about a hazard until detailed infor- 
mation about it has been received. Alternatively, 
it is possible that the failure of our information 
to affect levels of worry was due to the artificial 
nature of our survey, which may have encour- 
aged participants to process information at a 
relatively shallow level. Had our information 
related to a risk that was of greater relevance to 
the participant, it might have resulted in more 
systematic processing, resulting in changes in 
worry (Trumbo, 1999). 

Conclusion 

The ability to measure perceptions that mem- 
bers of the public hold about the properties of a 
hazardous substance should help communica- 
tors judge how best to target their messages 
during a public health incident. We hope that 
the PATHS questionnaire will facilitate this. 
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Appendix I 

The Perceptions AbouT 
Hazardous Substances (PATHS) 
questionnaire 

Below are some statements that other people 
have made about X. For each one, please say 
whether you strongly disagree, disagree, neither 
agree nor disagree and agree or strongly agree. 
Do not worry if you are not entirely sure for 
some of the statements. We are interested in 
whether you personally agree or disagree with 
them, based on what you currently know. So 
even if you are not sure, please give your best 
answer, based on what you think. 

Mystery scale 

1 . X is a mystery to me. 

2. I do not understand X. 

3 . I have a clear picture or understanding of X. 

4. I have a good idea of how X works. 

Severity scale 

1 . I think that if someone does not receive 
treatment, the health effects of being 
exposed to X are usually permanent. 

2. I think that if someone does not receive 
treatment, the health effects of being 
exposed to X are usually serious. 

3 . I think that if someone does not receive 
treatment, the health effects of being 
exposed to X are usually mild. 

4. I think that if someone does not receive 
treatment, being exposed to X is usually 
fatal. 

5 . I think that people who are exposed to X 
usually make a full recovery, even if they 
do not receive any treatment. 



6. I think that if someone does not receive 
treatment, being exposed to X will usu- 
ally damage a person's organs. 

Hidden health effects scale 

1. I think that some of the health effects 
from X can take years to develop. 

2. I think that people who survive exposure 
to X often develop new health problems 
many years down the line. 

3 . I think that X can cause hidden damage to 
your body that only becomes apparent 
years later. 

4. I think that X can trigger health problems 
that only affect you years later. 

5 . I think that even people who do not expe- 
rience any health effects in the weeks 
after exposure to X might still become ill 
years later. 

Easy to spot exposure scale 

1 . I think that it is easy for normal people to 
spot X 

2. I think that you can detect X by either 
taste, smell or sight. 

3. I think that there are easy ways for a nor- 
mal person to tell if X is present in a room. 

Difficult to discriminate symptoms scale 

1 . I think that it is easy to mistake the symp- 
toms caused by X with the symptoms of a 
different illness. 

2. I think that the symptoms of exposure to 
X are similar to those caused by other 
common illnesses. 

3 . I think that the symptoms of exposure to 
X are easy for a normal person to confuse 
with something else. 

77;e existence of at-risk groups scale 

I think that the health effects of X are usually 
more severe for the following: 

1 . Children aged below 5 years. 

2. Pregnant women. 

3. People who are 65 years old or more. 

4. People who already have a serious medi- 
cal condition. 
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Mechanisms. Different substances can affect 
your health in different ways. Below are several 
statements about ways that X might affect some- 
one. For each one, we are interested in whether 
you think that X is able to affect a person in that 
way or not. 

I think that X can affect your health if: 

1. You breathe in air that contains X. 

2. You eat food that has been contaminated 
with X and has not been cooked. 

3. You eat food that has been contaminated 
with X and has been cooked. 

4. You touch X but do not breathe it or put 
it near your mouth. 



5. You are coughed or sneezed on by a per- 
son who is currently ill because of X. 

Symptom latency. If someone is exposed to X, 
how long do you think it usually takes before 
the first signs of ill health start to appear? 
Response options of: 

Less than 24 hours. 

24 hours to 2 days. 

3 to 6 days. 

1 to 2 weeks. 

3 weeks to 1 month. 

1 to 2 months. 

More than 2 months. 



